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Abstract In this report, we propose a new hierarchical neural network composed of pulse neurons which 
imitate real neurons and its reinforcement learning algorithm with network extension. In the proposed algorithm, 
sequential input-output space is investigated by making use of randomness, so the network learns desired output 
indicated by reinforcement signal. The proposed pulse neural network has three layers: an input layer, a hidden 
layer and an output layer. All of the neurons are pulse neurons. This network learns relations between input 
pulse sequences and the desired outputs by updating connection weights and adding neurons corresponding to the 
input-output relation dynamically. We carried out the computer simulation to confirm the performance of the 
proposed algorithm. 
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